Clusterwise Linear Regression with the Least Sum of Absolute Deviations – An MIP Approach
نویسندگان
چکیده
In this paper, we study the application of mixed-integer programming (MIP) to the clusterwise linear regression (CLR) problem with the least sum of absolute deviations, which is a type of CLR problem that has received both theoretical and practical interests in recent years. We formulate the problem with a big-M formulation and investigate related issues, including the integration of outlier detection into CLR analysis. To improve the global optimization solution, we explore the resolution of breaking the solution symmetry that is prevailing in conventional formulations of many clustering analysis problems. Our numerical studies on randomly generated problem instances and two real data sets offer insights into the computational performance of solving the MIP formulations.
منابع مشابه
FUZZY LINEAR REGRESSION BASED ON LEAST ABSOLUTES DEVIATIONS
This study is an investigation of fuzzy linear regression model for crisp/fuzzy input and fuzzy output data. A least absolutes deviations approach to construct such a model is developed by introducing and applying a new metric on the space of fuzzy numbers. The proposed approach, which can deal with both symmetric and non-symmetric fuzzy observations, is compared with several existing models by...
متن کاملAnalysis of least absolute deviation
The least absolute deviation or L1 method is a widely known alternative to the classical least squares or L2 method for statistical analysis of linear regression models. Instead of minimizing the sum of squared errors, it minimizes the sum of absolute values of errors. Despite its long history and many ground-breaking works (cf. Portnoy and Koenker (1997) and references therein), the former has...
متن کاملOn Computing Minimum Absolute Deviations Regressions by Iterative Least Squares Regressions
This note considers some aspects of the computational problem of k fitting the regression model Yt ~ ti~l Xit~i +~t (t ~ 1, 2, ... , n) by minimizing the sum of absolute deviations ~~lIYt ~=l Xit~il The iterative method recently proposed by Schlossmacher (1973) is shown to have undesirable features under certain conditions. The linear programming approach using the simplex method as suggested b...
متن کاملDeviations Regressions by Iterative Least Squares Regressions and by Linear Programming
This note considers some aspects of the computational problem of by minimizing the sum of absolute deviations Yt = t 1 x· t l3· l= l l fitting the regression model (t = 1, 2, ... , n) r!: 1 x· t l3·1 l= l l The iterative method recently proposed by Schlossmacher (1973) is shown to have undesirable features under certain conditions. The linear programming approach using the simplex method as sug...
متن کاملRegularized fuzzy clusterwise ridge regression
Fuzzy clusterwise regression has been a useful method for investigating cluster-level heterogeneity of observations based on linear regression. This method integrates fuzzy clustering and ordinary least-squares regression, thereby enabling to estimate regression coefficients for each cluster and fuzzy cluster memberships of observations simultaneously. In practice, however, fuzzy clusterwise re...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012